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Abstract 

This paper contains an U' improving result for convolution oper- 
ators defined by singular measures associated to hypersurfaces on the 
motion group. This needs only mild geometric properties of the sur- 
faces, and it extends earlier results on Radon type transforms on W^. 
The proof relies on the harmonic analysis on the motion group. 

1 Introduction 

The classical Radon transforms satisfy improving properties (see [7]) and 
they are closely related to certain convolution operators associated to singular 
measures (see e.g. [IS])- The above results have been extended in many ways, 
not necessarily related to convolution structures, see e.g. [5], [12], [15] and 
the references therein. 

Our starting point is the following result, proved in pj^. 

Theorem 1 Let T he a convex compact curve in the plane and let 7 he the 
arc-length measure ofV. We identify 6 e [0, 27r] with e*^ G S"^ (the unit cir- 
cle). Let 7e he the rotated measure, i.e. J^2 f (x) djg (x) = J^2 f (e*^a^) d'y (x). 
Consider the operator T defined hy 

Tf{x,9) = {f*^.jg){x) , 

where x G and denotes the convolution in M^. Then 

II^/IIl3(R2x51) ^ C 11/11 ^3/2(lR2) . 

The proof of this theorem relies on an estimate for the average decay 
of the Fourier transform 7 proved by A.N. Podkorytov in [S] (see also [3]), 
which has been extended to several variables in The following statement 
is different from the one in [2], but it can be proved by a mild variation of 
the original argument. 
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Theorem 2 Let T be a compact convex submanifold of codimension 1 in M" 
(i.e. r can be seen as the graph of a convex function defined in a convex 
domain in W^~^). Let 7 = ^cr where a is the surface measure on T and x is 
a smooth cutoff supported in the interior ofT. Then 



where duj is the normalized measure on the unit sphere ^. Moreover the 
constant c depends only on x o-nd the diameter ofV. 

The above theorem easily imphes the foUowing extension of Theorem [1] 
(see [I]). For k G SO{n) and 7 a measure on M", let 7^ be defined by 

/^n fd-ik = /k„ f{ky)d-f (y), so that %{^) = 7(^"^0- 

Theorem 3 Let T be a compact convex submanifold of codimension 1 in 
and let 7 = xcx where a is the surface measure on T and x is a smooth cutoff 
function supported in the interior ofT. Consider the operator T defined by 



where x G M", k G SO{n) and *^ndenotes the convolution in M". Then 



The operator T in TheoremlSJcan be seen as a convolution operator on the 
motion group M„, which is R" x SO{n) equipped with the group product 
{x,k){y,h) = {x + ky, kh) and unit (0,e). Indeed the convolution of two 
functions F and G on M„ is defined by 



where dh is the Haar measure on SO{n). 

Note that if F {x, k) = f (x) and fi denotes the measure on M„ defined 




Tf (x, k) = (/ 7fc) (x) , 



\\Tf\\ 



L"+i(R"xSO(n)) 





by 
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we have 



{x,k)= [ F{. 



Jm, 



X — kh 



y,kh ^ 



) dfi {y, h) 



(1) 



/ fix 



kh ^y) djh {y) dh 



Jm, 




ky) d-f iy) dh 



Jm, 




ky) d-f {y) = (/ *un 7^) (x) . 



The above family {7A:} of hypersurfaces in turns out to be a manifold 
in R"- X SO{n). Indeed for any fco G SO{n) the coset {(x, fco) : x G M"} 
contains the n — 1 dimensional manifold F^q, i.e. the manifold F rotated by 
/co- The union of the manifolds F^^ is a hypersurface X in x 50(77.). 

When = 2, the F's are convex curves and their union can be seen as 
a 2-dimensional surface in M? x S*^; the picture shows this surface in the 
particular case F (t) = (t, + 1), together with the plane 6 = tt: 



In this paper we want to replace the above manifold X with a more 
general manifold y in x SO{n), so that the action of F as a convolution 
operator on M" is averaged not only on rotations, but on a wider family of 
transformations. In order to deal with this more general setting it is natural 
to work in the Euclidean motion group M„ rather than in M" x SO{n) and 
take advantage of the representation theory of M„. 
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2 Main result 

The following is our main result. By ([1]) it is an extension of Theorem [31 

Theorem 4 Let n > 2 and let Y be a suhmanifold of codimension 1 
in Mn- Assume that Y can be locally represented as F{x,k) = with 
VxF {x, k) 7^ 0. Assume furthermore that for every ko G SO{n) the in- 
tersection Y n {(a;,fco) : x G M"} is a convex hypersurfac^ in M". Choose 
X & Cl (Mn) and let be the measure on M„ given by Jj^j fdfi = fy fx^c, 
where a is the surface measure on Y . Then, ifTf (x, k) = (/ *if„ d^) {x, k), 
we have 

\\Tf\\ (2) 

Proof. Without loss of generality, we may assume that Y is the graph of 
the function 

Xi = $ (x', k) , 
where we use the notation x' = (x2, . . . , a;„). Thus 



fdjj. = / / ($ (x', k) , x', k) V (x', k) dkdx', 

M„ J SO{n) 

where v is the product of x by a Jacobian term. For every 2; G C, let iz be 
the distribution on M defined by 

(^.,^) = ^y^ r]{t)e-^dt. 

We define the family of distributions /i^ by 

/^^ = t^*M„ h, 
where Iz is the distribution defined by 

Iz (x, k) = iz (xi) (g) 60 (X2) ■ ■ ■ (S) 5o (xn) (S) 6e (k) . 
For any k G SO{n) define the measure fik on M" by 

gd^k = / g {x' , k) , x') u {x' , k) dx' . 

Then define the distribution ii^^ on M" by 

Ez (x) = iz (Xi) (g) (5o (X2) (g ■ ■ ■ (g) 5o (Xn) 



^This means that the above intersection is the graph of a convex function on a convex 
set (after choosing suitable coordinates in 
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and let nl = Hk *r" E^. Then it can be easily shown that 



/ (x, k) djj {x,k) = If {x, k) djik {x) dk 

M„ JsO{n) 



(/^^/)A^„ = / {f^lJi-^k))^r.dk. 

JsOin) 

We introduce the analytic family of operators 

Then the proof follows from Stein's complex interpolation theorem and the 
following result. 

Lemma 5 For every real s we have 

Ti+*^ : L' (M„) (M„) , (3) 

y-(n-l)/2+is . ^2 ^^^^ _^ j2 ^^^^ _ 

Proof of the Lemma. Let us prove (jS]) first. Indeed for g E 

1 



r(i + zs) 
1 



rOO 



(g *A/„ /i) (xi, 0, . . . , 0, e) x\'dxi 
5( ((xi,0,. . . ,0,e) 



Jm„ 



T{l + ts 
dfx {yi, . . . ,yn,k) dxi 

rOO 

I 9{{xi,0,---,0,e){yi,...,yn,k)) 



1 



r(i + zs) 



JAl 



(i/i {yi, . . . ,yn,k) dxi 



1 



+ 00 



T{l + is 

r+oo 



g (xi + yi, 1/2, ... , 2/„, fc) rf/i (yi, . . . , ?/„, fc) rfxi 

JMn 



g {xi + ^ {y, k) , y', k) x^u {y' , k) dkdy'dxi 

SO{n) 



(where /i is defined by /^^^ / {y, k) dji {y, k) = /^^^^ / ({y, k) ^) djx {y, k) ). 

The substitution yi = xi + ^{y',k), along with the boundedness of u, 
immediately gives 



< C ll«l|ii(M„) ) 
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so that G (M„). This proves ©. 

Now we turn to the proof of (jl]). We need first to recall a few facts from 
the representation theory of M„. 

The unitary dual Mn {n > 2) can be described in the following way (here 
is a reference for the representation theory of M„, see also [H]). Let L = 
SO (n — 1), considered as a subgroup of SO{n). For each a E L reahsed on a 
Hilbert space of dimension d^j consider the space {SO{n), a) consisting 
of functions (f on SO{n) taking values in C'^'^^'^'', the space of dcr x d^r complex 
matrices, satisfying the condition 

if (ik) = a (i) ip (k) , ieL, keSOin) 

which are also square integrable on SO{n): 

f yf,k=f t.(^W>W)*<=o. 

JsO(n) JsO{n) 

Note that {SO{n) , 0") is a Hilbert space under the inner product 
{^,i:)= [ ti {^{kyi^{k))dk. 

JSO{n) 

For each A > and a E L we define a representation TCx^a of M„ on 
iSO{n), a) as follows. For cp E {SO{n), a) and (x, k) E Mn let 

tta^o- (x, k) ip (i) = exp (2TciXi~^ei ■ x) p (ik) , 

where ei = (1,0, ...,0) and i E SO{n). If Pj (k) are the column vectors 
oi p E L^SO{n),a) then pj (ik) = a {£) pj (k) for all i E L. Therefore 
{SO{n),a) can be written as a direct sum of d^ copies of H {SO{n),a) 
which is defined to be the space of square integrable p : SO{n) C^"^ 
satisfying 

^ (ik) =a{i)ip{k), iEL. 

It can be shown that ttx^^ restricted to H {SO{n),a) is an irreducible repre- 
sentation of Mn- Moreover, any infinite dimensional irreducible unitary rep- 
resentation of Mn is unitarily equivalent to one and only one nx^a- Finite di- 
mensional irreducible unitary representations of SO{n) also yield irreducible 
unitary representations of M„. As they do not appear in the Plancherel 
formula we neglect them. We remark that when n = 2 the unitary dual L 
contains only the trivial representation. 

Given f E {Mn) H (M^) we define the group Fourier transform of / 

by 

TTx,a{f)= / f {x,k)'Kx,a {{x,k)~^) dxdk . 
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It can be shown that 71^,0- (/) is a Hilbert-Schmidt operator on H {SO{n), a) 
and we have the Plancherel formula 

r+00 p 

y\ / \\7Tx.Af)fHS^'"''d^=^n / \f{x,k)fdxdk, 
^ Jo JMn 

where denotes the Hilbert-Schmidt norm. 

Applying Plancherel formula to 2"~("--i)/2+«s j gg^- 



,2 

,2 



rp—[n—l)/2+is y| 
_ r+00 



crgL 



where IHlop is the operator norm on H {SO{n),a). We shall show below 
that 

uniformly in A and a, so that 



r+00 

We now prove ([5]). For ip^ip & H {SO{n),a) we have 

tta.o- ((a;, ^)~^) V (^) = (— 27riAn^^ei • k~^x) ip {uk~^^ . 
Assume for a moment Kez > 0, then fi^ is a measure and 

7rA,a (/i"") <-P (u) 

= nx,a {{x,k)~^) ip{u)dn^x,k) 

J Mr, 

= / exp(-2.a„-'e..r'x)^K-')d*.'(x.^. 
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Therefore 



SO{n) 



SO{n) JM, 



exp (— 27riA'u ^ei ■ k ^x) [uk ^) , (■u))^^^^ djj,^ {x, k) du 



ISO(n) JSO(n) 



exp (— 27r2A A; u ^Ci ■ a;) ((^9 (wfc 



50{n) JSO{n) 



^l{\ku ^ei){ip{uk , 'ip (u)") dudk 
'jlk [Xku^^ei) Ez [Xku^^ei) (^(f [uk^^) , ip (u))^^^ dudk. 

ISO{n) JSO{n) 

By analytic continuation, the equahty 

{^^")V.i^)H(SO(n),a) 

Jlk (Afc-u^^ei) Ez [Xku^^ei) (uk^^^ ^ip (u))^^^ dudk 



'SO{n) JSO{n) 

holds also for 2; = — (n — 1) /2 + is. By Cauchy-Schwarz inequality 



lj,k{Xku ^ei) E_(^ri-i)/2+is{Xku ^ei){^[uk ^) , ip (u)) du 

SO{n) 

< {uk~'),^{u)) 



\ \L2{SO{n),du) 

Pik{Xku'^ei) ^-(„-i)/2+is (A/cM~^ei) 
By O Ch. 2] we know that 

-E_(„_i)/2+is (AA;M"^ei) 



L2(50(n),d«) 



< CA("-i)/l 
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Now 



exp (-27ri^ ■ ($ (x', k) , x')) v (x', k) dx' 

u (x', k) 



I exp(-27ri^ ■ ($ ^ 



+ \V^,<^{x',k)[ 



X a/1 + |V:,'$(x',A;)|W 



exp (— 27rz,^ ■ x) 



V (x', A;) 



where d^fc is the surface measure of the convex hypersurface in M" given by 
the intersection Y fl {(x, /c) : x G M"}. By Theorem [2] we get 



y.k{\ku ^ei) £'-(n-i)/2+is (Afcw ^ei) 

i50(n) 

To end the proof we observe that 

/ W'^(w))c''JlL2(50(n),d«) 
^SO(n) 



L2(SO(n),dM) 



50{ri) LJ50(n) 



1/2 



1/2 



< <! / / \(if){uk) ,'^{u))^i„\ dudk 

lsO{n) J SO{n) 

1/2 

< <! / / \^{uk)\^\i){u)\^ dudk 

yJsO{n) JsO{n) 

By Fubini's theorem and the invariance of the Haar measure on SO{n) we 
get 



SO{n) 



I {if (Uk) , ^ (u))^,, \\mS0(n),du) ^ y\\H(SOin),a) II ^ II J/(50(n),<x) • 



This ends the proof of the Lemma. Hence Theorem H] is proved. 



Remark 6 For functions on which are independent of the rotational 
variable, i.e. for functions F such that F{x,k) = f{x), Theorem^ can be 
obtained from Theorem 0. Indeed 

l/(n+l) 



SO{n) 



\F *M„ (x, A;)!""*"^ dxdk 



< / / / f {x - kr ^y) dfir (y) dr 

\^JsO{n)JM." JsO{n)jR" 



n+1 



l/{n+l) 



< 



SO{n) I JSO(n) 



f [x-kr ^y) dur (y) 



n+1 



SO{n) \JSO{n) 



n+1 



dxdk 

N l/(n+l) 

dxdk > dr 

l/in+l) 



f{x- ay) dfir (y) 
\ / \ f *Rr. ij,^^^{x)\'^^^ dxdai dr 

SO{n) lJsO{n) JR" ) 



dxda 

l/(n+l) 



dr 



< 



SO{n) 



dr = c \\F\\ ^ n+1 



where fir,cr denotes the measure fir rotated by a. This yields the following 
weaker version of Theorem^ For a general F let F (x, k) = sup^g^o(„-) \F (x, kr) \ 
then 



\^ * /^IIli+icm™) - 



F * n 



< c 



n + 1 



C\\F\\ n + 1 

"l," (L?°(M„)) 



The above seems to be the best we can get by using earlier results such as the 
ones in fl^. 

Remark 7 A familiar example (the characteristic function of a small ball) 
and the previous remark can be used to show that the indices in ([^ cannot 
be improved. 

Remark 8 It is interesting to compare Theorem^ with Theorem 1.1 in 
where it is shown that the improving property of a measure is related to 
the fact that the supporting manifold generates the full group. 

Remark 9 The techniques in our paper are in nature and they seem 
to provide only V — results. We do not know how to get mixed norm 
estimates similar to the ones which have been proved in [Wf through certain 
U estimates for the average decay of Fourier transforms (note that in general 
these U estimates cannot be obtained by interpolation between and L°° , 
see e.g. l^). 
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